Theoretical Exploration on Local Stability of Simultaneous Recurrent Neural Network Dynamics for Static Combinatorial Optimization
نویسندگان
چکیده
Abstract— This paper presents a theoretical local stability analysis of the Simultaneous Recurrent Neural network (SRN) as a nonlinear dynamic system operating in relaxation mode for static combinatorial optimization. Specifically, stability of hypercube corners of the SRN dynamics, which are equilibrium points for high-gain node dynamics and useful entities to represent solutions of combinatorial optimization problems, is examined. A theorem that exposes existence of network weights to establish hypercube corners as stable equilibrium points is stated. Theoretical insight obtained in this study combined with extensive simulation based empirical evidence reported in the literature to date suggests that the SRN dynamics operating in relaxation mode appears to possess desirable stability characteristics as a recurrent neural network for addressing combinatorial optimization problems.
منابع مشابه
Stability of Simultaneous Recurrent Neural Network Dynamics for Static Optimization
A new trainable and recurrent neural optimization algorithm, which has potentially superior capabilities compared to existing neural search algorithms to compute high quality solutions of static optimization problems in a computationally efficient manner, is studied. Specifically, local stability analysis of the dynamics of a relaxation-based recurrent neural network, the Simultaneous Recurrent...
متن کاملTraining Simultaneous Recurrent Neural Network with Resilient Propagation for Static Optimization
This paper proposes a non-recurrent training algorithm, resilient propagation, for the Simultaneous Recurrent Neural network operating in relaxation-mode for computing high quality solutions of static optimization problems. Implementation details related to adaptation of the recurrent neural network weights through the non-recurrent training algorithm, resilient backpropagation, are formulated ...
متن کاملA Recurrent Neural Network Model for solving CCR Model in Data Envelopment Analysis
In this paper, we present a recurrent neural network model for solving CCR Model in Data Envelopment Analysis (DEA). The proposed neural network model is derived from an unconstrained minimization problem. In the theoretical aspect, it is shown that the proposed neural network is stable in the sense of Lyapunov and globally convergent to the optimal solution of CCR model. The proposed model has...
متن کاملThe Simultaneous Recurrent Neural Network for Addressing the Scaling Problem in Static Optimization
A trainable recurrent neural network, Simultaneous Recurrent Neural network, is proposed to address the scaling problem faced by neural network algorithms in static optimization. The proposed algorithm derives its computational power to address the scaling problem through its ability to "learn" compared to existing recurrent neural algorithms, which are not trainable. Recurrent backpropagation ...
متن کاملAn efficient one-layer recurrent neural network for solving a class of nonsmooth optimization problems
Constrained optimization problems have a wide range of applications in science, economics, and engineering. In this paper, a neural network model is proposed to solve a class of nonsmooth constrained optimization problems with a nonsmooth convex objective function subject to nonlinear inequality and affine equality constraints. It is a one-layer non-penalty recurrent neural network based on the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003